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Markov  Chain  Moment  Formulas  for 
Regenerative  Simulation 

Abstract 

Let  {A'n  :  n  >  0}  be  a  regenerative  Markov  chain  on  a  general  state  space,  and  /  a  real- valued  bounded 
function.  Let  r  and  Z  be  random  variables  that  have  the  distribution  of  a  regeneration  cycle  length  and  the 
sum  of  /(A'i)  over  a  cycle,  respectively.  This  paper  derives  expressions  for  moments  of  the  form  E(t^ Z^), 
which  are  then  used  to  gain  insight  into  the  qualities  of  regenerative  estimators  beksed  on  different  regeneration 
points. 

KftvworJs 

Regenerative  simulation,  moment  formuleis,  Markov  chains. 

1.  Introduction 

The  regenerative  method  of  simulation  output  analysis  uses  the  fact  that  the  interblocks  of  a  regenerative 
stochastic  process  are  independent  and  identically  distributed  to  construct  a  consistent  estimator  of  the 
variance  constant  used  to  derive  confidence  intervals.  If  a  process  has  more  than  one  regeneration  point,  the 
estimator  will  have  the  same  limiting  value  no  matter  which  point  is  used  to  block  the  observations.  While 
all  such  estimators  have  the  same  limit,  different  regeneration  points  may  yield  variance  estimators  with 
different  variances.  A  common  rule  of  thumb  for  obtaining  an  estimator  with  low  variance  is  to  choose  the 
regeneration  point  that  has  the  least  mean  regeneration  time. 

Glynn  and  Iglehart  ([5])  proved  a  bivariate  central  limit  theorem  for  the  regenerative  point  estimator 
and  the  standard  deviation  estimator.  Numerical  calculations  presented  in  the  paper  showed  that  the  off- 
diagonal  element  in  the  covariance  matrix  appeared  to  be  independent  of  the  return  state  used  to  delimit 
regenerative  cycles.  The  purpose  of  this  paper  is  to  derive  an  expression  for  the  covariance  matrix  that 
appears  in  the  central  limit  theorem  in  the  case  ^  dass  of  Markov  chains.  The  expressions  derived  show 
that  the  off-diagonal  term  is  independent  of  the  re>  i  state.  Some  insight  is  gained  into  the  nature  of  the 
variance  of  the  vuiance  estimators  for  different  return  states.  An  example  is  given  where  the  state  that 
yields  the  least  variable  vairiance  estimator  has  the  greatest  mean  regeneration  time. 

By _ 

Distribution  / 


2.  Notation 


Let  {S,S)  be  a  measurable  space,  where  the  ir-field  S  is  countably  generated  (for  example,  S  could  be  a 
metric  space  and  S  its  Borel  o-field).  Let  P  be  a  Markov  kernel  on  (S,S),  and  put  P°{x,  ■)  =  6,.,  and  for 
n  >  1, 

P''{x,A)  =  J^P’'-\x,dy)P{y,  A). 

For  auiy  initial  probability  if,  the  Markov  kernel  P  determines  a  probability  measure  P,p  on  the  product 
measurable  space  n^=o(‘^"’ '''’here  each  (S",S'')  =  iS,S),  through  the  relations 

P^'^o  e  Ao,  - ,Xn  e  An)  =  f  f{dxo)  I  P{xo,dxi)  ■  ■  ■  f  P(z„_2,dx„_i)P(i„_i,  A„) 

where  A'i  is  the  projection  of  (S‘,5*).  We  write  £^p  for  the  expectation  with  respect  to 

the  probability  P^,  and  ‘\{  f  =  6z,  then  we  write  P*  and  Ef 

For  A  €  S,  s^  will  denote  the  first  return  time  of  the  chain  to  the  set  A  and  will  denote  the  first 
hitting  time  of  the  set  A  (s  and  r  coincide  unless  the  chain  starts  in  A,  in  which  case  =0).  We  will  write 
Si  and  Ti  instead  of  s{i}  and 
For  A  G  S  and  z  <E  S  let 


P”  (A)  =  Pi{Xn  €  A-,X„  ^z,0<k<  n}, 


and  define  the  kernels 

00 

gt(z,A)  =  ^n*p;,(A),  ifc  =  0,l,.--. 

n=l 

Qo(x,  A)  is  the  expected  amount  of  time  the  chain  spends  in  A  before  absorption  at  z. 

We  will  consider  only  chains  that  are  uniformly  f -recurrent]  that  is,  there  exists  a  <r-finite  measure  f 
such  that  if  f(A)  >  0,  then  Px[ta  >  n]  — ►  0  uniformly  in  z  G  S’.  Uniformly  ^recurrent  chains  have  a  unique 
invariant  probability  measure,  which  will  be  denoted  by  v.  We  assume  that  the  chain  is  aperiodic. 

Throughout  the  paper  z  will  denote  a  fixed  return  state  with  5r({z})  >  0.  When  subscripts  are  omitted 
the  state  will  be  understood  to  be  z:  e.g.  £(r)  =  £j(r,). 

A  consequence  of  the  uniform  recurrence  is  that  for  every  z  6  S,  Ei{rf)  <  oo,  and  therefore  Qo(x,  ) 
and  Qi(x,  ■)  are  finite  measures  for  each  z,  with  respective  variations 

Qo(z,5)=f;P.{r,>n}  =  £.(r,) 

n=l 


and 


<3i(z,5)  =  ^nP,{r,  >n}  =  ^  )  Pr{T,  =  n} 

n=l  n=l  '  ' 


Note  that  Qi(2,{z})  =  E{t). 
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For  the  chain  to  be  Harris  recurrent  (also  called  i^recurrent)  requires  only  that  there  exist  a  cr-finite 
measure  ip  such  that 

p(A)  >  0  =>  PxIta  <  oc]  =  1 

for  every  x  £  S.  Thus  we  are  considering  a  sub-class  of  Harris  recurrent  Markov  chains. 

Let  F{S)  denote  the  Banach  space  of  bounded  measurable  functions  from  S  to  with  supremum  norm, 
and  denote  by  M(S)  the  Banach  space  of  finite  signed  measures  on  (S,  5)  with  total  variation  norm.  We 
will  use  the  same  notation  ((  ■  (j  for  both  norms,  the  context  making  clear  which  one  applies. 

There  is  a  natural  bilinear  functional  connecting  F(S)  and  M{S),  given  by 

(a*.  /)  —  a*/  =  ^ 

wh  -e  p  g  Af(5)  and  /  g  F(S).  If  N  is  a  kernel,  p  g  M(S),  and  /  g  F(S),  we  obtain  a  measure  pA'  and  a 
bounded  function  A’/  given  by 

HN{A)  =  j^n{dx)N{x,A), 

and 

N/(x)  =  J^N{x,dy)f(y). 

An  expression  such  as  pA/  is  unambiguous,  since 

Ai(A/)  =  (pA)/. 

If  A'  and  Af  are  kernels,  we  define  the  composition  of  M  and  A,  MA,  by 

MN{x,A)  =  M(x,dy)N{y,A). 

Composition  is  associative,  so  we  can  write  an  expression  such  as  fiNMQf  without  parentheses.  To  avoid 
excessive  use  of  parentheses  we  adopt  the  convention  that  functions  are  multiplied  first  in  an  expression:  for 
example,  if  f,g,h£.  F{S),  then 

^iNfMgh  =  ^lN{f{M{gh))). 

Let  f  be  a  bounded  real  valued  function  on  S,  with  Ewf{X)  =  0. 
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3.  Transition  Probability  Lemmas 

The  purpose  of  the  lemmas  in  this  section  is  to  give  expressions  for  Qk  in  terms  of  the  n-step  transition 
probabilities  for  the  Markov  chain. 

We  will  meike  use  of  the  following  fact  (Theorem  6.1  in  [8]). 

Lemma  1:  Consider  a  chain  on  (5,5)  which  is  uniformly  ^recurrent.  If  the  chain  is  aperiodic,  there  exist 
a  <  oo  and  p  <  1  such  that 

II  (Ai  -  A2)P"  ||<  ap"  II  Ai  -  Aj  II 

for  any  two  probability  measures  Ai  and  Aj  on  (5, 5). 

Proof:  See  [8].  | 

Define  the  kernels 

OO 

n(r,d]/)  =  x(dy),  G  =  ^(P"-n),  Ht{x,A)  =  E,{rhPi^,A),  fc  >  0, 

n  =  l 

Ho(x,A)  =  P(z,  A)  -  P{x,  A), 

and  let 

<7(x)iE,(r,). 

The  function  g  is  measurable  and  by  assumption  is  bounded.  We  will  use  the  notation  G*  to  denote  the 
measure  G(z,  •). 

By  Lemma  1,  expressions  such  as 

(p-j/)G,  {p-v)Qi 

denote  finite  measures  for  any  probability  measures  fi  and  v. 

Lemma  2: 

Qk  =  Q*n  -  j  (/  +  G). 

In  particular,  for  dl  ^4  €  5  and  x  6  5 

Qo{x,A)  =  9{x)i^{A)  +  G(x,  A)  -  G(z,  A) 


and 

Qi (x,  A)  =  (Ji(x,  S)t(A)  +  G(x,  /I)  -  G(z,  A)  +  GG(x,  A)  -  GG(z,  A)  -  9{x)G,{A)- 

Note  that  Qoiz,  )  = 

Proof:  By  definition 

I  n'‘P;,idy)P(y,  A)  =  n‘P-+n>l) 

Js\U] 

=  {n  +  i)‘p;/‘(>i)  +  E  +  i)‘->p;+'(>i). 
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Summing  over  n  gives 


/  Q,(x,dy)P(y,A)  =  Qt{x.  A)  -  P.,(A)  +  ^  A)  -  P,,(A)} 

y5\{z}  “  \jy 


=  Qt{x,  >1)  +  XI  ■ )  (-iyQt-j{x,A)  -  PrM)hl‘=0} 
;  =  1 


and  so 


Qi(x,  dy)P(y,  A)  =  Q,{x,  A)  +  {-!)> A)  +  Qt{x,  {x})P(z,  A)  -  P,,(A)l{t=o}  • 


We  can  write  the  last  equation  as 


or 


QkP  =  Qk  +  Yl 

i=i 


Iterating  the  last  equation  gives 


Q*  =  g^P"  - ^  (-ly Q*->  j^P'-H,j^P'. 
;  =  1  1=0  1=0 


Letting  n  — >  oo  and  using  bounded  convergence  gives 


Qt  =  Q*n-  +  + 


which  is  the  result.  | 
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4.  Moment  Calculations 

Let  r  and  Z  be  random  variables  that  have  the  same  distributions  as  r,  and 

n=l 

respectively,  under  P^. 

In  this  section  we  will  derive  expressions  for  moments  of  the  form  E(t'Z^).  These  moments  will  be 
expressed  in  terms  of  the  following  quantities: 


Xi  =  »/?. 

X2  =  + 

??i  =  —(^z  +  Gz )/, 

and 

,,2  =  -{Sz  +  Gz)f  -  2(6.  +  G.)fGf. 

We  begin  by  determining  expressions  for  E(Z^).  Below  we  define  several  quantities  that  depend  on  the 
transition  probability  of  the  chain,  but  not  on  the  return  state  z.  For  consistency  of  notation,  w  will  use 
mj  to  denote  the  quantity  usually  called  (both  notations  will  be  used).  Let 

<7^  =  mzix/^  +  Zir/G/ 

00 

=  E,f{X,)^  +  2'^E,[f{Xo)f{Xn)], 

na:l 

m3  =  E./iXof  +  af;  f:,[/(Xo)V(^n)]  +  ^f2Er[f(Xo)f(X„f] 

n=l  n=l 

00  00 

E  E,z[f(Xo)fiX„)f(Xn+rn)], 

n=l  m=l 

and 

m4  =  Erf(Xo)*  +  4  f;  ^,(/(Xo)V(;^r.)]  +  4  EAf(Xo)fiX„f] 

n=l  n=l 

+6f;{f:,[/(Xo)V(An)*]  -  E.[f(Xof]E,\/iXn?]} 

n=l 

+12  f;  f;  {E.[f(Xo?f(Xn)f(X„+,„)]  -  E,[f{Xof]E,[f{X„)f(X„+,r,)]} 

n=l  m  =  l 

+12  f;  f;  E,[/(Xo)/(x„)V(^n+m)]+ i2f;  f;  E,[f(Xo)f(x„)fix„+r.?] 

n=lm  =  l  n=lm  =  l 

00  00  00 

+24  EEE  Eii[f(Xo)f(Xn)f{Xn^m)f(Xn+m+k)], 

n=l  m=l  t=l 
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and  in  general 


- = t  c.)  (" ("  ■ "  -r- ■ 

where  the  second  sum  is  over  all  positive  pi  that  sum  to  n. 

Lemma  3:  If  the  series  in  the  definitions  of  mi.ma,  and  converge  absolutely,  then 

E  (Z^)  =  E(T)m2, 

E{Z^)  =  E{T)(m3  +  Zm-i(\i  +  rji)) , 

and 

E  (Z*)  =  £(r)^m4  +  4m3(>;i  +  r?i)  +  6m2  (ixi  +  mf  +  x\  +  n}  +  \2  +  V::))  ■ 


Proof:  Add  to  S  a  new  state  A  with  /(A)  =  0,  and  define  random  variables  {{„}  taking  values  in  SU{A} 
by 

Xk  =  z  for  some  0  <  i:  <  n, 
otherwise 


.  if. 


According  to  the  definition,  =  Xq  and  4t,  = 

We  will  establish  the  third  moment  result.  Using  the  random  variables  defined  in  (1), 


/  00  00  oo  oo  oo 

=  E  3  E  E  /(^")V«n+m)  +  3  ^  ^  /Un)/(Cn 

^n  =  l  nslmsl  nsrlmsl 


oo  oo  oo 


+6  EEE/^^")/^  n+m)/(?n+m  +  0  ] 

n=l  m=l  /=!  ' 


00  00 


=  E^'  [/(^n)"i  +3^  ^  E,  +3^  [/u„)/u„+m)"] 


n=  1 


n  =  l  msrl 
00  00  00 


nsl  msl 


+®E  E  E^*  [/{^n)/«n+m)/({n+m+t)] 

n=lm=l  1=1 

where  the  interchange  is  allowed  because  of  the  assumed  absolute  convergence  of  m3 

=  E  /  +3f;  f;  f  p:Adx)f{x)^  f  p^,{dy)f{y) 

+3E  E  /  P:Adx)f{x)  f  PrAdy)f{y? 

+6  E  E  E  /  P:Adx)nx)  f  P^Ady)f{y)  f  PlA<^v)f(v) 


(1) 


7 


=  go(-.  ■)/"  +  3Qo(-',  ^f-Qof  +  3Qo(-'.  ■)fQof  +  6Qoiz,  AfQofQof 
-y(z)Qoiz,  ■)P  -  tf{z)Qo{z,  ■)fQof 
=  E{t)  [wp  +  ZTTf-Qof  +  3^/Qo/'  +  &^fQofQof] 
-3f{z)Qo{z,  ■)f  -  6f{z)Qo{z,  ■)fQof 
=  E(r}m3  +  3m2(xi  +  »?i). 


and  the  result  follows  from  Lemma  2. 

The  second  and  fourth  moment  results  follow  from  similar  arguments.  | 

The  next  lemma  gives  expressions  for  some  of  the  mixed  moments. 

Lemma  4:  If 

then 

E[TZ]  =  E(r)(xi+m)- 

Also 

E  [tZ^]  =  ^  £(^2)1  ^  2£(r)tr/G/  +  +2E{r)irfGGf 

+  £'(’■)  ((Xi  +  i7i)^  +  Xi  +  'll  +  X2  +  'Ja)  ■ 

Proof:  Using  the  random  variables  defined  by  (1), 

=  f;  E,  (r,/a„)) 

a=l 

(where  the  interchange  is  allowed  by  the  lemma’s  hypothesis) 

00  OO  OO 

=  53  £,  [/(?„)  (n  +  S(,.)]  =  53  n  •  E,[f[i„)]  +  53  £.[/««)*{..] 

n=I  n-l  n=l 


OO  OO  OO  OO 

=  53  n  ■  £,[/({„)]  +  ^  +  E  l^"l] 

nsl  nsl  n=l  n=l 

=  E"  /  P?,{dx)nx)  +  f^  [  P-{dx)f{x)Er{s,) 

=  f  f^nPP,idx)f(z)+  j  f;/>;,(rfr)/(x)£’.(s,) 

=  Qiiz,dx)f(x)  +  Qo{z,  dx)f{x)Er{8,) 
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(the  interchange  is  justified  since  np"j(  )  converges  absolutely) 

=  ■)/  +  Qo(-.  ■)fg  -  <30(2.  {z})fiz)E,{T,} 

=  -9{:)G^f  +  g(z)irfg  -  g(z)f(z) 

=  +  Xi) . 


which  is  the  desired  result. 

Proceeding  similarly  for  the  second  equation, 


£(rZ‘)  =  ^  [/‘(^n)(n  +  s^.,)]  +2  EE  Ez  [(n  +  m  +  Sf.  +  n.»)/(^n)/(^n+m)] 

fi  =  1  n=  1  m  =  l 

oo  00 

=  ^  tie,  [/'(^n)su^] 


n  =  l  m  =  l 

/ 

00  oc  00  00 

+  2E  E  ">^4/(^n)/(^n+m)]  +  2E  E  )Sf ..] 

n  =  lm=l  n  =  l  mssl 

DC  -  00  M  00  00  A  A 

=  E  "  /  +  E  /  ^;.(rf2:)/(z)2£,(s,)  +  2E  E  ”  /  P?zidx)f{x)  /  P”(<fy)/(y) 

+2E  E  m  /  P"  (dx)/(x)  f  prz(dy)f{y) 
ds\U}  Js 

+2E  £  /  /  P”(dy)/(y)£y(s.) 

=  Qi(2,  •)/'  +  go(2,  o/'y  -  3(2)/(2)'  +  2Qi(2.  O/Qo/  +  2Qo(2,  j/gi/  -  2/(z)Q,(z,  .)/ 
+2^0(2,  ■)fQofg  -  2/(2)^(z)5r/^  +  2/(z)^y(z) 

=  [gi(2.5)7r  -  g(z)Gz]f^  +  9{z)Trf^9  +  2[Qi(z,S)n  -  y(z)G,]/btr  +  G-G,]f 
+2g{z)TT f[Qi{x,  S)tt  +  G  —  Gj  +  GG  —  GG*  —  gG,]/  t-  2g(z)Tr flgir  +  G  —  Gj]/ff 
+?(2)/(2)^  -  2f(z)g{z)vfg  -  2/(z)[Qi(z,  S)t  -  p(2)G,]/ 

=  gi(2, S)x/2  -  g{z)G,f^  +  s(z)x/2<,  +  2Q,(z,S)TTfGf  +  2g{z)(G,ff  -  2g{z)GzfGf 
+2(7(r)T/G/  +  2g(z)iTfGGf  -  2g{z){7Tfg){G.f)  +  2g[z){TTfgf  +  2ff(2)x/G/<7 
■*-g(^)f(^)^  -  2/(z)g(z)}r/g  +  2/(r)p(z)G,/ 

=  gi(z,  S)mj  +  2EiT)irfGf  +  2E{T)itfGGf 
+E(T)[-G,f  +  TTf^g  +  2{G.ff  -  2GzfGf  -  2{iTfg){G.f)  +  2{TTfg)^ 

+2rfGfg  +  /(z)2  -  2/(z)tr/j,  +  2/(r)(G,/)] 

=  Qiiz.SW  +  2E{T)iTfGf  +  2E{T)TTfGGf  +  E{t)  [r;2  +  2r,\  +  2xirh  +  2x\  +  X2]  , 
as  desired.  | 
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5.  Estimator  Covariance  Matrix 


Let  So  =  0,  and  5'o  =  /(A'o)  +  •  •  •  +  /(A'n-i).  Under  the  assumptions  on  the  chain  given  in  section  2, 

1 


as  n  oo,  and 


as  n  —  oo.  We  are  interested  in  estimating  <t^  in  order  to  obtciin  confidence  intervals.  In  the  regenerative 
method,  Sn  is  divided  up  into  independent  blocks  by  starting  a  new  block  whenever  a  regeneration  point  is 
reached.  If  Z;  is  the  iik  block  and  Kn  is  the  number  of  regenerative  cycles  in  the  first  n  observations,  then 


1  1 
<t2=  lim  -E{Zi  +  ZK,f  =  lim  -Y'ZfZf) 

n  — 00  n  n— oo  n  ■' 

J  =  1 


as  n  — ‘  oc.  Choosing  different  regeneration  points  will  in  generad  give  different  estimator  variances. 

Let  r(n)  and  s(n)  denote  the  regenerative  mean  and  standard  deviation  estimators,  respectively,  based 
on  observation  of  the  chain  up  to  time  n; 


K  K 

»•('>)  =  ^  E  A^i).  s(n)^  =  i  {Zi  -  r{n)Tjf  . 


K. 

H 

3=1  " 3=1 

It  is  shown  in  [5]  (for  general  regenerative  processes)  that 

(r(n)  -  r,  s(n)  -  (t)  =>  ^(0,  D), 


where 


and 


Du  =  EiZ^)IE(r), 


Du 


E{Z^)  -  Z<7^ E(rZ) 
2<tE(t) 


£>22  =  {E{Z*)  -  2a-E{TZ'^)  +  <t‘^E{t'^)  -  E(r)-^  (4E(rZ)E(Z^)  -  8(r^[E(rZ)]^))  /  (4<r^E(r)) . 


Using  the  formulas  from  Lemmas  3  and  4,  the  covariance  matrix  can  be  written 


c  +  Xi  +  »7i 
^  +X2  +  r,2 


where 


A  m4 

^"472 


4 


-  ir/G/  -  ir/GGf 
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is  independent  of  the  return  state.  Notice  that  the  diagonal  term  is  also  independent  of  the  return  state  c, 
since  as  previously  mentioned,  and  m3  are  independent  of  the  return  state. 

Let 

y/n(r{n)  —  r)  =>  a, 

\/n(s(n)  —  (t)  ^  b, 

wh  -e  we  view  a  and  6  as  elements  of  the  Hilbert  space  L2  with  inner  product 


(i.y)  =  E(xy). 


Then 


It  follows  that  we  can  write 


where  (a,  q)  =  0  and 


m3 


(u,a)=tT^  (6,6)  =  D22,  ia,b)=^. 


b=j^a  +  q, 


=  4^4(7)^  ■ 

For  a  random  variable  with  finite  third  moment  define  the  coefficient  of  moment &1  skewness  ([10])  of  A' 
by 

EiX  -  £A)3 
2var(A)3/2  ’ 

Let  K„  be  the  coefficient  of  momental  skewness  for  the  random  variable  y/(n)Sn  under  the  initial  distribution 
JT.  Clearly  k„  is  defined  independently  of  the  return  state,  and 

^  l-  ^3 

K  =  hm  K„  = 

With  this  notation,  £>12  =  k(t^,  and  the  orthogonal  decomposition  is 


b  ■=  Ka  +  q. 


For  any  syntmetrical  chain,  for  example  a  birth  and  death  process  on  {~N,  •  •  • ,  0,  •  •  ■ ,  N)  for  which  the  birth 
and  death  parameters  as  well  as  the  values  of  the  function  /  are  symmetrical  about  0,  k  =  0  and  so  a  and  b 
are  orthogonal. 

Choosing  a  return  state  to  minimize  variance  of  the  standard  deviation  estimator  is  equivalent  to  choos¬ 
ing  a  return  state  to  maximize  correlation  between  the  estimators  for  the  mean  and  the  standard  deviation. 


6.  Example 

Consider  the  Markov  chain  with  state  space  5  =  {1,2,3}  and  transition  matrix 

"l-f  f  0 

P=  1/2  0  1/2  , 

0  f  l-f_ 

for  0  <  €  <  1.  The  stationairy  distribution  is 

/  1  _2c _ l\ 

^  \2  +  2€’ 2+2(' 2  +  2f  )  ’ 

Let  /  =  (  — M,  0,  Af)  for  some  M  >  0;  then  £,/  =  0.  The  values  of  the  quantities  that  vary  with  state  are 
given  below  (the  values  for  state  3  are  the  same  as  for  state  1). 

State  ril  X?  ^2  \2 


The  difference  in  variances  is 

£>22(1) -£>22(2)  =  2^^)  , 

while 

£i(n)  =  £3(r3)  =  2  +  2€  —  2,  £2(r2)  =  oo 

as  €  i  0.  Therefore,  while  the  mean  regeneration  time  for  state  2  grows  without  bound  as  e  |  0,  it  gives  the 
lecist  variable  estimator,  with  the  difference  going  to  oo  as  e  i  0.  Essentially  all  of  the  difference  is  accounted 
for  by  the  and  x?  terms. 

In  this  example,  the  kurtosis  of  Sn  increases  as  M  increases  or  e  decreases,  so  the  variance  of  all  3 
standard  deviation  estimators  increases  as  f  i  0. 

7.  Conclusion 

The  covariance  matrix  that  appears  in  the  central  limit  theorem  for  the  regenerative  mean  and  standard 
deviation  estimators  has  been  expressed  in  a  form  so  that  several  conclusions  could  be  reached.  First,  the 
off-diagonal  term  is  independent  of  the  return  state  chosen  for  blocking.  Second,  the  expression  for  the 
variance  of  the  standard  deviation  estimator  shows  that  the  variance  is  increased  by  kurtosis  in  the  partial 
sum  process.  The  variance  does  depend  on  the  return  state  used  for  blocking,  and  an  example  showed  that 
the  state  with  the  shortest  mean  return  time  can  give  the  most  variable  standard  deviation  estimator. 
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